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ABSTRACT 

Parametric cost models are used to plan missions, compare concepts and justify technology investments. This paper 
reviews an on-going effort to develop cost modes for space telescopes. This paper summarizes the methodology used to 
develop cost models and documents how changes to the database have changed previously published preliminary cost 
models. While the cost models are evolving, the previously published findings remain valid: it costs less per square 
meter of collecting aperture to build a large telescope than a small telescope; technology development as a function of 
time reduces cost; and lower areal density telescopes cost more than more massive telescopes. 

Keywords: Space Telescope Cost Model, Parametric Cost Model 

1. INTRODUCTION 

Parametric cost models for space telescopes provide several benefits to designers and space system project managers. 
They identify major architectural cost drivers and allow high-level design trades. They enable cost-benefit analysis for 
technology development investment. And, they provide a basis for estimating total project cost. A survey of historical 
models found that there was no definitive space telescope cost model [1]. Thus, there is a need for parametric space 
telescopes cost models. An effort is underway to develop single variable [2] and multi-variable [3] parametric space 
telescope cost models based on the latest available data and applying rigorous analytical techniques. Since the 
publication of the single and multi-variable parametric models, the data base has changed. New telescopes were added 
to the data base; data for other telescopes was revised; and, other telescopes were removed from the modeling analysis. 
As a result of these changes, the cost models have changed. But the general findings remain unchanged: aperture 
diameter is the primary cost driver for large space telescopes; technology development as a function of time reduces 
cost; it costs less per square meter of collecting aperture to build a large telescope than a small telescope; and it costs 
more per kg to build a low areal density telescope than a massive telescope. 

2. METHODOLOGY 

Cost and engineering data has been collected on 59 different parameters 
for 39 x-ray, UV, optical, infrared, microwave and radio space 
telescopes. But to date, only the 32 normal-incidence UV, Optical, 

Infrared (UVOIR) missions have been studied for cost modeling. And, 
of these 32, sufficient data exists for only 15 with which to develop an 
Optical Telescope Assembly (OTA) cost model (Table 1). Data was 
collected from multiple sources, including: NAFCOM (NASA/ Air 

Force Cost Model) database, RSIC (Redstone Scientific Information 
Center), REDSTAR (Resource Data Storage and Retrieval System), 
project websites, and interviews. 

For our study, Optical Telescope Assembly (OTA) is defined as the space observatory subsystem which collects 
electromagnetic radiation and focuses it (focal) or concentrates it (afocal). An OTA consists of the primary mirror, 
secondary mirror, auxiliary optics and support structure (such as optical bench or truss structure, primary support 
structure, secondary support structure or spiders, etc.). An OTA does not include science instruments or spacecraft 
subsystems. And, cost is defined as prime contract cost without any NASA labor or overhead. Total mission cost is 
defined as Phase A-D cost, excluding: launch cost; costs associated with NASA labor (civil servant or support 

contractors) for program management, technical insight/oversight; or any NASA provided ground support equipment, 
e.g. test facilities. Accounting for NASA overheads would increase the cost by at least 10% and maybe as much as 33%. 





Statistical correlations have been evaluated between 18 of 59 variables. And, these parameters have been used to 
develop single variable cost estimating relationships (CERs) which are evaluated for their ‘goodness’. The variables are 
divided between technical (Aperture Diameter, PM Focal Length, System Focal Length, Field of View, Pointing 
Stability, OTA Mass, Total Mass, Spectral Range Minimum, Wavelength of Diffraction Limit, Operating Temperature, 
Average Input Power, Data Rate, Design Life, and Orbit) and programmatic (Technology Readiness Level, Year of 
Development, Development Period, and Launch Year). Additionally, insight is gained by combining independent 
variables to form collector variables (F/#, Volume, Areal Cost or Cost Density). 

Two single variable cost estimating relationships (CERs) are reported in this paper. These CERs estimate OTA cost as a 
function of OTA diameter and OTA mass. 


3. MODEL CREATION 

The first step in creating a statistical cost model is to start with the Cross Correlation Matrix (Figure 1) and look for 
variables which are highly correlated with cost. When using a cross-correlation matrix, there are several things to 
consider. First, the higher the correlation value, the greater the cost variation explained by that variable. Second, the 
sign of correlation is important. It must be consistent with known engineering design principals and manufacturing 
processes. Third, for multi-variable models, we want variables which independently effect cost. Variables which ‘cross- 
talk’ with each other are multicollinear. 
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Figure 1: Cross-Correlation Matrix of data base for 15 Space Telescope Systems. Correlations which are at least 95% significant are 
Bolded, e.g. for 12 data points a correlation of greater than 60% is significant to better than 95%. 

A careful study of the cross-correlation matrix shows that OTA Cost is highly correlated with Aperture Diameter, 
Primary Mirror Focal Length, System Focal Length, Pointing Stability, Total Mass, OTA Mass, Design Life and 
Development Period. But, caution is required because not all of these variables are independent. Aperture Diameter 
correlates with PM Focal Length and System Focal Length, simply because larger aperture telescopes tend to have 
longer focal lengths. Also, because larger aperture telescopes have smaller point spread functions (or plate scales) they 
need to have smaller pointing stabilities, hence, the inverse correlation between aperture size and pointing. Obviously, 


the larger the telescope aperture, the more massive the telescope will be. Additionally, the accompanying science 
instruments will undoubtedly be larger and more massive as well as the spacecraft. It is interesting to note that there 
does not appear to be a correlation between cost and operating temperature or diffraction limited performance. One 
explanation might be that they tend to cancel each other out. While the mirrors for longer wavelength systems are easier 
to manufacture, their cryogenic operating temperature increases cost. And, while visible systems operate at room 
temperature, their mirrors and structures are more difficult. 

The second step is to select candidate CER variables and perform a regression analysis (Figure 2). The statistical 
indicators of ‘Goodness of Fit’ and ‘Significance’ are used to evaluate the results of this analysis. Goodness of Fit is 
tested via a range of statistical measures, including Pearson’s r 2 coefficient. Student T-Test p-value and standard percent 
error (SPE). Pearson’s r 2 (typically denoted as just r 2 ) describes the percentage of agreement between the model and the 
actual cost. For multi-variable models, we use Adjusted Pearson’s r 2 (or r 2 aclj ) which accounts for the number of data 
points and the number of variables. In general, the closer r 2 (or r 2 a dj) is to 1.0 or 100%, the better the model. SPE is a 
normalized standard deviation of the fit residual (difference between data and fit) to the fit. The closer SPE is to 0, the 
better the fit. Please note that since SPE is normalized, a small variation divided by a very small parameter coefficient 
can yield a very large SPE. The p-value is the probability that a fit or correlation would occur if the variables are 
independent of each other. The closer the p-value is to 0, the more significant the fit or correlation. The closer it is to 1, 
the less significant. If the p-value for a given variable is small, then removing it from the model would cause a large 
change to the model. If it is large, then removing the variable will have a negligible effect. Also, it is important to 
consider how many data points are included in a given correlation, fit or regression. 
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Figure 2: Single Variable Regression Analysis for OTA Cost 


4. SINGLE- VARIABLE MODELS 

From an engineering and a scientific perspective, aperture is the best parameter with which to build a space telescope 
cost model. Aperture defines the observatory’s science performance (sensitivity and resolution) and determines the 
payload’s size and mass. As discussed in Section 3, Aperture Diameter correlates with all of the other variables which 
significantly correlate with cost. From Figure 2, OTA cost varies as a function of diameter according to: 

OTA Cost ~ Diameter 1 75 (N = 15; r = 67%; SPE = 146) 

This CER is based on 15 data points, one of which (SOFIA) is not actually a space telescope. But as shown in Figure 3, 
SOFIA’S OTA cost is ‘in-family’ for its aperture. And, removing SOFIA from the regression has a negligible effect: 

OTA Cost ~ Diameter 18 (N = 14; r = 6 7%; SPE = 142) 

However, both CERs only account for 67% of the cost variation and both are noisy. Therefore, a single variable aperture 
diameter model is not a good CER. Other variables are needed to account for the remaining 33% of cost variation. 




Figure 4: OTA Areal Cost vs Aperture Diameter 


One concern about cost versus diameter is that JWST drives the fit. As a simple sanity check, the data was normalized 
by collecting area to define Areal Cost (Figure 4). By eliminating the diameter influence, data spread associated with 
second order factors such as wavelength or operational temperature can be identified. The key point of Figure 4 is that 
areal cost decreases as a function of aperture diameter. Thus, given that the number of collected photons is proportional 
to collecting area, larger aperture telescopes have a greater return on investment (ROI) than smaller aperture telescopes. 


While an Aperture based CER may be most logical for an optical engineer, many believe that Mass is the more 
important CER. Total system mass determines what vehicle can be used to launch the mission. And, significant 
engineering costs are expended to keep a given payload inside of its allocated mass budget, for example: light-weighting 
mirrors and structure. It is factual to assert that space telescopes are designed to meet a specific mass budget. From 
Figure 2, OTA cost varies as a function of mass according to: 

OTA Cost ~ OTA Mass °' 97 (N = 12; r 2 = 56%; SPE = 88) 


Compared to the Aperture Diameter CER, OTA Mass is less noisy. But, it still only accounts for 56% of the cost 
variation. One problem is that this CER is based on 12 data points, one of which (SOFIA) is not actually a space 
telescope. SOFIA is actually an ‘attached’ telescope. It flies attached to a 747 aircraft. And, by flying on a 747 aircraft, 
it can be designed to an entirely different mass budget paradigm. But, as shown in Figures 3 and 5, while SOFIA has the 
approximately the same aperture size and OTA mass as HST; it has a significantly different cost than HST. One 
explanation might be because SOFIA has a longer diffraction limited wavelength but still operates close to ambient 
temperature. Another explanation might be that SOFIA does not have the challenges of operating in space, i.e. in 
vacuum or micro-gravity. Removing SOFIA from the regression has a significant effect: 

OTA Cost ~ OTA Mass " (N = 11; r 2 = 96%; SPE = 78%) 


Without SOFIA, the OTA Mass CER accounts for 96% of the cost variation and has a smaller standard percent error. 


Another potential wavelength story is Herschel and Kepler. Herschel and Kepler have essentially the same mass and 
cost, but vastly different apertures, diffraction limits and operating temperatures. Based only on aperture, Herschel 
should be more expensive than Kepler, but it has a significantly longer diffraction limit and lower operating temperature. 
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Figure 5: OTA Cost vs OTA Mass 


Figure 6: OTA Cost Density vs Aperture Diameter 


A very interesting tool for analyzing the role of mass on cost is cost density (cost per kg). Figure 6 plots OTA cost per 
kg versus OTA aperture diameter. Several obvious conclusions can be drawn from Figure 6. First, all free flying space 
telescopes have approximately the same cost per kg - independent of aperture diameter. And, all ground telescopes also 
have approximately the same cost per kg - independent of aperture diameter. And, space telescopes cost about 1000X 
per kg more than ground telescopes - independent of aperture diameter. Second, while the conclusion regarding 
attached telescopes might appear to be equally obvious (that attached telescopes are approximately 5X less expensive 
than free-flying), it is not. For the three shuttle missions (UIT, WUPPE and FlUT), the data base only has ‘instrument’ 
data, i.e. cost and mass of the telescope and science instruments (detectors, electronics, etc.). More research is required. 
Thus, the only conclusion which can be drawn from Figure 6 is that it costs more per kg to make low areal density flight 
telescopes than it costs to make massive ground telescopes. One explanation for this data might be that each of these 
mission ‘types’ are built to different design rules. While all three types need similar wavefront shape and pointing 
stabilities as a function of aperture diameter, they have different static gravity and dynamic jitter environments; and 
different mass budgets for achieving the required wavefront shape and pointing stability. 

A final caution about using mass as a CER can be found by considering FIST vs JWST. While the FIST and JWST 
OTAs have similar mass and cost (although JWST is a bit more expensive), this relationship does not hold at the system 
level. FIST system mass is nearly 2X more than JWST, yet JWST is slightly more expensive than FIST. 

5. CONCLUSIONS 

Cost models are invaluable for system designers. They identify major architectural cost drivers and allow high-level 
design trades. They enable cost-benefit analysis for technology development investment. And, they provide a basis for 
estimating total project cost. Cost and engineering data has been collected on 59 different parameters for 39 x-ray, UV, 
optical, infrared, microwave and radio space telescopes. But to date, only the 29 normal-incidence UV, Optical, Infrared 
(UVOIR) missions have been studied for cost modeling. And, of these 29, sufficient data exists for only 15 with which 
to develop an Optical Telescope Assembly (OTA) cost model. Statistical correlations have been evaluated between 18 
of 59 variables. And, these parameters have been used to develop single variable cost estimating relationships (CERs) 
which are evaluated for their ‘goodness’. 

From an engineering and a scientific perspective, aperture is the best parameter to build a space telescope cost model. 
Aperture defines the observatory’s science performance (sensitivity and resolution) and determines the payload’s size 
and mass. OTA cost varies as a function of diameter according to: 

OTA Cost ~ Diameter 1 75 (N = 15; r 2 = 67%; SPE = 146) 

This CER is based on 15 data points, one of which (SOFIA) is not actually a space telescope. If SOFIA is removed from 
the regression it has a negligible effect: 

OTA Cost ~ Diameter 18 (N = 14; r = 67%; SPE = 142) 

Flowever, both CERs only account for 67% of the cost variation and both are noisy. Therefore, a single variable aperture 
diameter model is not a good CER. Other variables are needed to account for the remaining 33% of cost variation. 

A key point of the aperture model is that the diameter coefficient is less than 2. Therefore, areal cost decreases as a 
function of aperture diameter. Flence, given that the number of photons collected is proportional to collecting area, 
larger aperture telescopes have a greater return on investment (ROl) than smaller aperture telescopes. 

While an Aperture based CER may be most logical for an optical engineer, Mass may be a more important CER. Total 
system mass determines what vehicle can be used to launch a mission. And, significant engineering costs are expended 
to keep a given payload inside of its allocated mass budget. OTA cost varies as a function of mass according to: 

OTA Cost ~ OTA Mass °' 97 (N = 12; r = 56%; SPE = 88) 

Compared to the Aperture Diameter CER, OTA Mass is less noisy. But, it still only accounts for 56% of the cost 
variation. Flowever, this CER is based on 12 data points, one of which (SOFIA) is not actually a space telescope. 
Removing SOFIA from the regression has a significant effect: 

OTA Cost ~ OTA Mass 11 (N = 11; r 2 = 96%; SPE = 78%) 

Without SOFIA, the OTA Mass CER accounts for 96% of the cost variation and has a smaller standard percent error. 



Finally, cost density (cost per kg) as a function of aperture diameter indicates that for given ‘classes’ of telescopes of 
missions, the cost per kg is independent of aperture diameter. Thus, it costs more per kg to make low areal density flight 
telescopes than it costs to make massive ground telescopes. One explanation might be that it requires significantly more 
‘engineering’ effort to design a low areal density telescope with the required wavefront shape and pointing stability for 
its operational (static gravity load and dynamic jitter) environment than it does for a more massive telescope. 
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Parametric Cost Models 



Parametric cost models have several uses: 

• high level mission concept design studies, 

• identify major architectural cost drivers, 

• allow high-level design trades, 

• enable cost-benefit analysis for technology development 
investment, and 

• provide a basis for estimating total project cost. 


However 


All Cost Models are Wrong ! 


But Some are Useful. 


The Rest will get you into Trouble. 


DISCLAIMER 



Cost Models are only as good as their Data Base 

This is a work in progress. 


The results evolve as we add new missions to the 
Database, add data to or correct data in the Database. 


Findings 

Aperture Diameter is principle cost driver for space telescopes. 

OTA Cost ~ Diameter 18 
OTA Cost ~ Dia 1 6 X 0 25 

Larger diameter OTAs cost less per square meter of aperture. 
Longer wavelength OTAs cost less. 

If all parameters are held constant, adding mass reduces cost & 
reducing mass increases cost. 

Still examining Year of Development 
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Methodology 

Data accumulated on 59 engineering and programmatic variables 
1 8 Variables studied for Cost Estimating Relationships (CERs) 
Data sources : 

NAFCOM (NASA/ Air Force Cost Model) database, 

NICM (NASA Instrument Cost Model), 

NSCKN (NASA Safety Center Knowledge Now), 

RSIC (Redstone Scientific Information Center), 

REDSTAR (Resource Data Storage and Retrieval System), 
SICM (Scientific Instrument Cost Model), 
project websites, and interviews. 



Cost & Mass Definitions 


l 

i 

Total Mission: 

• Spacecraft 

• Science Instruments 

• Telescope 

Instrument: 

• Entire payload or experiment including telescope 

Optical Telescope Assembly (OTA): 

• Primary mirror 

• Secondary (and tertiary if appropriate) mirror(s) 

• Support structure 

• Mechanisms (actuators, etc.), Electronics, Software, etc. 

• Assembly, Integration & Test 


Cost & Mass Definitions (2) 



Cost includes: 

• Phase A-D (design, development, integration and test) 


Cost excludes: 

• Pre-phase A (formulation) 

• Phase E (launch/post-launch) 

• Government labor costs (NASA employees: CS or support 
contractors) 

• Government Furnished Equipment (GFE) 

• Existing Contractor infrastructure which is not ‘billed’ to contract. 

• These are ‘First Unit’ Costs only - no HST Servicing & there are no 
2 nd Systems. 


Mass includes: 


Dry mass only (no propellant) 


Technical Variables 



Aperture Diameter 
PM Focal Length 
System Focal Length 
Field of View 
Pointing Stability 
OTA Mass 
Total Mass 

Spectral Range Minimum 

Wavelength of Diffraction Limit 

Operating Temperature 

Average Input Power 

Data Rate 

Design Life 

Orbit 


Programmatic Variables 



TRL (Technology Readiness Level) 

Year of Development (or Start of Development) 
Development Period 
Launch Year 


Missions (8.6.H Database) 


Currently 45 missions in data base 

33 4 normal- incidence’ UVOIR and 
Infrared telescopes 

5 grazing incidence X-Ray 

7 Radio/Microwave 


Data for microwave, radio wave 
& grazing incidence X-Ray /EUV 
provides wavelength diversity 

To date only normal-incidence 
UVOIR and Microwave 
telescopes used for cost modeling 


Cost Model Missions Database (8.6.1 1) 

X-Ray Telescope 

Infrared Telescopes 

Chandra (AXAF) 

CALIPSO 

Einstein (HERO-2) 

Herschel 

EUVE 

IRAS 

FOXSI 

ISO 

HERO 

JWST 


SOFIA 

UV/Optical Telescopes 

Spitzer (SIRTF) 

Commercial #1 

TRACE 

Commercial #2 

WIRE 

Copernicus (OAO-3/PEP) 

WISE 

EO-l/ALI 


EUVE 


FUSE 

Microwave Telescopes 

GALEX 

ACTS 

HST 

Cloud SAT 

HUT 

Planck 

ICES at 

WMAP 

IUE 


Kepler 


LANDSAT-7 

Radio Antenna 

LRO/LROC NAC 

SWAS 

MO/MOC 

TDRS-1 

MO/MOLA 

TDRS-7 

MRO/HiRISE 


OAO-B/GEP 


SDO/AIA 


SOHO/EIT 


STERO/SECCHI 


UIT 


WUPPE 



Missions (8.6.H Database) 



Of 37 ‘normal-incidence’ UVOIR 
and Microwave telescopes 

27 are Tree Flying’ 

4 are ‘Attached’ and 

5 are ‘Planetary/Other’ 

Additionally, some of these are 
Imaging and others are 
Spectroscopic. 

We have not yet investigated the 
impact of this distinction, but 
expect spectroscopic to be lower 
cost. 


Normal Incidence Database (8.6.11) 

Free Flying Telescope 

Attached Telescopes 

ACTS 

HUT 

CALIPSO 

SOFIA 

Cloud SAT 

UIT 

Commercial #1 
Commercial #2 
Copernicus (OAO-3/PEP) 

WUPPE 

EO-l/ALI 

Planetary Telescopes 

EUVE 

LRO/LROC NAC 

FUSE 

MO/MOC 

GALEX 

MO/MOLA 

Herschel 

MRO/HiRISE 

HST 

ICESat 

IRAS 

ISO 

IUE 

JWST 

Kepler 

LANDSAT-7 

OAO-B/GEP 

Planck 

SDO/AIA 

SOHO/EIT 

Spitzer (SIRTF) 

TRACE 

WIRE 

WISE 

WMAP 

STEREO/SECCHI 


Missions (8.6.11 Database) 


For some have only Mission data 
and for others have both OTA and 
Mission data. 


We have OTA Cost: 

& Diameter data for 15 
& Mass data for 13 


Cost Model Variables for Free Flying 

UVO/IR Systems (rev. 11.6.10) 

Parameter 

% of data 

Total Cost 

89% 

OTA Cost 

46% 

Total Cost & OTA Cost 

68% 

Aperture Diameter 

100% 

PMFLen. 

71% 

System F Len. 

89% 

FOV 

86% 

Pointing Stability 

39% 

Total Mass 

93% 

OTA Mass 

86% 

Spectral Range minimum 

96% 

Diffraction Limited Wavelength 

61% 

Operating Temperature 

93% 

Avg. Input Power 

89% 

Data Rate 

79% 

Design Life 

96% 

TRL 

32% 

Year of Dev. 

93% 

Dev. Period 

89% 

Date of Launch 

96% 

Orbit 

82% 

Average 

78% 


Missions (8.6.H Database) 



These are the missions used in 
our cost model analysis 

15 are ‘Free Flying’ 

4 is ‘Attached’ and 

1 is ‘Planetary’ 

Of theses 8 are spectroscopic 
or non-imaging. 


Normal Incidence Database (8.6.1 1) 

Free Flying Telescope 

Attached Telescopes 

Cloud SAT 

HUT 

Commercial #1 

SOFIA 

Commercial #2 

UIT 

Copernicus (OAO-3/PEP) 

GALEX 

Herschel 

WUPPE 

HST 

Planetary Telescopes 

IRAS 

JWST 

Kepler 

OAO-B/GEP 

Planck 

Spitzer (SIRTF) 

WIRE 

WISE 

MRO/HiRISE 


Agenda 



• Introduction and Summary 

• Data Collection Methodology 

• Statistical Analysis Methodology 

• What to Model?: OTA or Total Mission Cost 

• Single Variable Modes: Mass and Diameter 

• Multi- Variable Models 

• Conclusions 


Model Creation 



Start with Correlation Matrix. 

Look for Variables which are Highly Correlated with Cost. 

The higher the correlation the greater the Cost Variation which is 
explained by a given Variable. 

Sign of correlation is important and must be consistent with Engineering 
Judgment. 

Important for Multi- Variable Models: 

We want Variables which Independently effect Cost. 

When Variables ‘cross-talk’ with each other it is called Multi-Collinearity. 
Thus, avoid Variables which are highly correlated with each other. 


Goodness of Correlation, Fits and Regressions 

‘Correlation’ between variables and ‘Goodness’ of single variable 
models is evaluated via Pearson’s r 2 standard percent error 
(SPE), and Student’s T-Test p- value. 

‘Goodness’ of multivariable fits are evaluated via Pearson’s 
Adjusted r 2 which accounts for number of data points and 
number of variables. 

Pearson’s r 2 coefficient describes the percentage of agreement 
between the fitted values and the actual data. 

The closer r 2 is to 1, the better the fit. 

SPE is a normalized standard deviation of the fit residual 
(difference between data and fit) to the fit. 

The closer SPE is to 0, the better the fit 



Significance 

The final issue is whether or not a correlation or fit is significant. 

p-value is the probability that the fit or correlation would occur if 

the variables are independent of each other. 

The closer p-value is to 0, the more significant the fit or correlation. 

The closer p-value is to 1, the less significant. 

If the p-value for a given variable is small, then removing it from the 
model would cause a large change to the model. 

If p-value is large, then removing the variable will have a negligible effect 

It is only possible to ‘test’ if the correlation between two 
variables is significant. 

It is not possible to ‘test’ if two variables are independent. 



Cross-Correlation Matrix 


rev. 8.1.11 

Total Cost 

OTA Cost 

Aperture 

Diameter 

6 

•j 

to* 

2 

a. 

Um 

yr C 

& 23 

FOV 

esD >, 

c E 

C3 -a 

1 5 

a. V) 

1 

£ 

VIO 

spectral 

Range 

minimum 

Diff. Lim X 

9 

H c. 

5 e 

Total Avg 
Input Power 

M 

2 

3 

2 

Design L ite 

P 

C 

p 

© 

ft 

£ 

Dev Pcnod 

Date of 
launch 

<5 

units 

(FY11SM) 

(FYllBf) 

&■) 

(m) 

(m) 

O 

(Arc-S®c 

S*c) 

(kg) 

(kg) 

04 

00 

(K) 

(W«n) 

(Kbpi) 

I'mrnrht) 

TILL 

<?W) 

(months) 


(km) 

Total Cost 

1.00 

0.85 

0.69 

0.21 

0.52 

0.13 

-0.72 

0.68 

0.85 

0.21 

-0.05 

-0.11 

0.57 

0.05 

0.30 

-0.45 

-0.15 

0.70 

0.03 

0.46 

OTA Cost 


1.00 

0.78 

0.88 

0.72 

-0.13 

-0.80 

0.84 

0.95 

-0.16 

-0.20 

0.04 

0.37 

0.22 

0.64 

-0.61 

-0.03 

0.62 

0.16 

0.07 

Aperture 



1.00 

0.36 

0.72 

-0.04 

-0.71 

0.59 

0.84 

0.51 

0.46 

-0.05 

0.44 

-0.10 

0.43 

-0.28 

-0.08 

0.45 

0.05 

0.05 

PMFLen. 




1.00 

0.70 

0.13 

-0.77 

0.69 

0.89 

-0.48 

-0.38 

0.18 

0.21 

0.04 

0.56 

-0.35 

-0.11 

0.41 

0.11 

0.00 

System F Leu. 





1.00 

-0.29 

-0.47 

0.61 

0.70 

0.02 

-0.13 

-0.04 

0.13 

-0.16 

0.60 

-0.38 

-0.22 

0.43 

-0.03 

0.18 

FOV 






1.00 

-0.33 

0.03 

0.27 

0.24 

0.26 

-0.12 

0.10 

0.19 

-0.15 

-0.31 

0.19 

-0.01 

0.18 

0.06 

Pomtmz 

Stabiitv 







1.00 

-0.62 

-0.87 

0.16 

0.18 

-0.13 

-0.46 

-0.03 

-0.54 

0.26 

-0.04 

-0.63 

-0.24 

-0.03 

Total Mass 








1.00 

0.92 

-0.10 

0.10 

0.01 

0.39 

-0.19 

0.46 

-0.54 

-0.31 

0.51 

-0.16 

0.24 

OTA \fctss 









1.00 

-0.22 

-0.22 

0.00 

0.27 

-0.17 

0.41 

-0.62 

-0.04 

0.69 

0.18 

-0.35 

Spectral Range 










1.00 

0.96 

-0.24 

0.16 

0.10 

0.06 

-0.09 

0.19 

0.17 

0.19 

0.12 


Diff Lrni >. 


1.00 


-0.28 0.10 0.15 
0.12 


-0.20 0.12 0.35 0.23 0.32 0.26 
0.27 0.11 


Total Avg. 
Incut Power 













1.00 

0.50 

0.57 

0.13 

0.59 

0.06 

0.57 

0.25 

Data Rate 














1.00 

0.14 

0.63 

0.72 

-0.09 

0.70 

0.28 

Design Life 















1.00 

-0.15 

0.12 

0.15 

0.25 

0.33 

Year of Dev 
Dev Period 



1.00 

0.67 

1.00 

-0.17 

-0.13 

1.00 

0.64 

0.97 

0.09 

0.32 

0.22 

0.36 

Date of Launch 



















1.00 

0.28 

Oifoxt 




















1.00 


Cross-Correlation Matrix 
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Correlations which are at least 
95% significant are Bolded, e.g. 
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for 12 data points a correlation of 
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greater than 60% is significant to 
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0.36 
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Cross-Correlation Matrix 
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OTA Cost has significant correlations with: 

Aperture Diameter 

Primary Mirror & System Focal Length (Volume) 
Pointing Stability (inverse correlation) 

OTA Mass 
Design Life 

Total Cost has significant correlations with: 

Aperture Diameter 

Primary Mirror & System Focal Length (Volume) 
Pointing Stability (inverse correlation) 

OTA & Total Mass 
Average Power 
Design Life 
Development Period 

No correlation for wavelength or temperature 
TRL correlation is ‘weak’ 
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Not all Correlated Variables are Independent 
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Larger Diameter OTAs: 

have longer Focal Lengths 

have smaller Pointing Stability Requirements 

are just bigger and thus more Massive 

have larger instruments with are more Massive & require Power 

require bigger spacecraft which are more Massive & require Power 

need a long Design Life 

take longer to Develop 

are more Recent - older OTAs were smaller 

All these variable are dependent on Aperture Diameter (co-linear). 
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Variable Linkages 
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Correlation Matrix can be used to identify variable cross-linkages which 
should be reconciled with Engineering Judgment. 

Aperture Diameter and Pointing Stability have a large negative 
correlation: Larger Diameter OTAs required smaller Pointing Stability. 

Pointing Stability and OTA Mass have a large negative correlation: 
Small Pointing Stability requires a very stiff, i.e. Massive, OTA. 
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Wavelength and Temperature 
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As expected Spectral Range and 

Diffraction Limit are highly correlated. 

Operating Temperature are inversely correlated. 

But neither are significantly correlated with Cost - probably 
because they cancel either other out. 
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OTA Cost or Total Cost 

Engineering judgment says that OTA cost is most closely related 
to OTA engineering parameters. 

But, managers and mission planners are really more interested in 
total Phase A-D cost. 
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OTA Cost or Total Cost 

Given that Total Cost tracks closely with OTA Cost, and that I’m 
an optics person and have accumulated mostly OTA data. 

Our primary emphasis is to develop an OTA cost model. 
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OTA Cost as a % of Total Mission Cost 

OTA Cost varies from approximately 1% to 25% of the Total. 

OTA’s cost as % of Total depends upon need to develop custom tooling 
or infrastructure - or use existing. 

WIRE is clearly questionable & under review. Also, have asked 
GALEX to clarify their CADRe cost (missing Structure cost) 




OTA Cost as a % of Total Mission Cost 

We have detailed WBS data for 7 of the 14 free flying missions. 
Mapping (5.3.11) database on common WBS gives OTA -10% of Total 
Some say that Power System is 20% of total mission Cost and Mass 
For 1960/1970 mission, electronics costs are greater than OTA coss. 
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OTA Cost Regression 

Regressing on 15 normal incidence, ‘free-flying’ UVOIR OTAs 

Significant Variables: Diameter, Focal Length, Volume, Pointing & Mass 

FL has the highest R 2 ad j and Mass has the lowest SPE 

Volume, FL & Diameter have acceptable R 2 ad j & SPE (but they all Dia) 
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Mass Model 


Mass Model 



As an optical engineer, my preference is to develop a model 
based on an optical parameter, i.e. Aperture Diameter. 

Aperture Diameter interests ‘users’ of space telescopes because it 
is directly proportional to sensitivity and resolution. 

But, many believe that Mass is the most important CER. 

Total system mass determines what vehicle can be used to launch. 

Significant engineering costs are expended to keep a given 
payload inside of its allocated mass budget. 

Such as light- weighting mirrors and structure. 


Space telescopes are designed to mass 


OTA Cost Mass Model #1 

Regressing on all OTAs in the data base: 

OTA Cost ~ OTA Mass 0 8 (TV = 17; r 2 = 42%; SPE = 142%) 
Mass accounts for only 42% of the cost variation & is noisy 




OTA Cost Mass Model #2 


I 

i 

Regressing on only Free-Flyer (excluding ‘attached’ and SOFIA) 
OTA Cost ~ OTA Mass 11 (N = 13; r 2 = 87%; SPE = 58%) 
Mass accounts for 87% of the cost variation with less noise. 
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OTA Cost Mass Model #2 



The 3 ‘attached’ missions & SOFIA clearly are a different ‘class’ 

They have a different set of design rules which allow them to 
have a lower cost for a given mass. 
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OTA Cost Density 

It costs more to design & build a low mass OTA than a high mass OTA 
Cost per kg depends on mission ‘type’; is independent of aperture size 


Free-Flying OTAs are ~2X more expensive per kg than Attached OTAs 
Free-Flying OTAs are ~15X more expensive per kg than SOFIA 
Free-Flying OTAs are 1000X more expensive per kg than Ground 


OTA Cost / kg vs Aperture Diameter (rev. 8.1.11) 
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Mass is not a Good CER 



It may appear that Mass is a good CER, but it is not. 


JWST & HST have same OTA mass, but JWST OTA costs is 2X HST 


HST Total mass is 2X JWST, but JWST Total cost is 2X HST 


The reason is complexity - JWST is more complex than HST 



Problem with Mass 



Mass may have a high correlation to Cost. 

And, Mass may be convenient to quantify. 

But, Mass is not an independent variable. 

Mass depends upon the size of the telescope. 

Bigger telescopes have more mass and Aperture drives size. 
And, bigger telescopes typically require bigger spacecraft. 

The correlation matrix says that Mass is highly correlated with: 


Aperture Diameter, Focal Length and Pointing 


But in reality it is all Aperture, the others depend on aperture. 


Aperture Model 


OTA Cost vs Aperture Model #1 

Regressing OTA Cost vs Aperture for all missions in database: 
OTA Cost ~ Diameter 16 (N = 20; r 2 = 80%; SPE = 142) 
Diameter accounts for 80% of the cost variation, but is noisy 




OTA Cost vs Aperture Model #2 

Regressing OTA Cost vs Aperture for just Free-Flyer missions 
(and excluding WIRE): 

OTA Cost ~ Diameter 14 (N = 15; r 2 = 82%; SPE = 123) 

Diameter accounts for 82% of the cost variation, is less noisy 




OTA Areal Cost 


I 

r 

Because coefficient for diameter is less than ‘2’, the areal cost 
(cost per area) decreases as telescopes become larger. 

Larger OTAs provide a higher ROI, less $ per photon. 

Also, more massive ‘attached’ and ‘ground’ have lower areal cost 
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Need for a second variable 



Assuming that Mass is not the right CER and that Aperture is 

Aperture Model only accounts for 70% of the cost variation. 

Therefore, other variables must account for the remaining 30% of 
the cost variation. 

Thus, a multi-variable model is required. 


First step is a residual analysis. 


How to develop a Multi- Variable Model 



Perform multi-variable regression to add a second variable. 

Select two variable model based on: 

Change in Significance of Diameter to Fit 
Significance of Variable #2 to Fit 
Increase in r 2 ad j 
Decrease in SPE 
Multi-Collinearity 


Some variables may increase r 2 ad j and/or decrease SPE, but they 
are not significant or their coefficients are not consistent with 
engineering judgment or they are multi-collinear. 


OTA Cost versus Diameter and V2 
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Diffraction Limit & Spectral Min are most significant, both increase R2 & decrease SPE 
OTA Mass increases R2 to 85%, but is multi-colinear with Aperture Diameter. 

Other mult-colinear variables are FL and Volume 
Don’t understand impact of Design Life on Diameter. 


Aperture Residual Error Analysis 

Divide data by Diameter Model (normalize data) and plot as a 
function of Variables. 

R 2 indicates how % of residual error explained by a 2 nd Variable 
For example, as expected diameter explains ‘zero’ variation 
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Aperture Residual Error Analysis: Wavelength 

Diffraction Limit Wavelength explains 97 % of residual variation 


A -0.2 coefficient implies that an OTA with a 10X longer 
wavelength will cost 40% less. 
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Aperture Residual Error Analysis: Temperature 


Operating Temperature does not significantly explain residual 
aperture variation 


But, it might be a good 3 rd or 4 th CER parameter 
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OTA Cost / Diameter A 1.5 vs. Operating Temp. 



Aperture Re sidual Error Analy sis: Y OD 


Year of Development does not significantly explain residual. 
But, it might be a good 3 rd or 4 th CER parameter 


Concern that Y OD is correlated with Aperture and Wavelength. 
Also, what is role of spectroscopic vs imaging. 


OTA Cost / Diameter A 1.5 vs. Year of Development 
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Two Variable Aperture Model 



Two second variables best meet all the criteria: 
Wavelength Diffraction Limit and 
Spectral Minimum 


Diffraction Limited Wavelength yields the best model: 


OTA Cost ~ Dia 1 6 V 0 25 


(N = 12, r 2 = 98%; SPE= 60%) 


r 



OTA Cost versus Diameter, Wavelength and V3 


Operating Temperature is the 
only significant 3 rd variable 


OTA Cost ~ D 17 V 13 T° 25 


(N = 11,1* = 96%; SPE= 54%) 


More effort is required to 
understand issues related to: 

Design Life 

Year of Development 
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Conclusions: Aperture 



Consistent with Engineering Judgment Aperture Diameter is a 
good CER for OTA Cost: 

OTA Cost ~ Diameter 14 (N = 15; r 2 = 82%; SPE = 123) 

1 variable only explains 82%, thus a 2 variable model is needed 

Two variable model using Wavelength Diffraction Limit explains 
98% of data variation with a low SPE. 

OTA Cost ~ Dia 1 - 6 V'- 25 (N = 12, r 2 = 98%; SPE= 60%) 

In all cases, Areal Cost ($/m 2 ) is less for larger telescopes 


Three Variable Aperture Model 

Temperature gives a statistically significant 3 Variable model: 

OTA Cost ~ D 17 V ,u T - 0 - 25 (TV = 11, r 2 = 96%; SPE= 54%) 

More effort is required to understand issues related to: 

Design Life 

Year of Development 



Comparison with Historical Models 
This study has identified a potential 3 variable model 

OTA Cost ~ D 17 X 0 3 T 0 25 
Bely Model (corrected): 

OTA Cost ~ D 16 X ' 018 T -°- 2 e - 0 033(Y01) - 1%, » 
Horak Model: 

OTA Cost ~ D °- 7 A ,' 018 T -°- 2 e -° ° 33,YOD - l96< " 


But Horak had a different data base. 


Conclusions: Mass 



OTA mass is not a good CER 

OTA mass is multi-collinear with diameter, and 
more massive telescopes actually cost less to make. 

For a given aperture diameter, 

Free-Flying OTAs are ~2X more expensive per kg than Attached OTAs 
Free-Flying OTAs are ~15X more expensive per kg than SOFIA 
Free-Flying OTAs are 1000X more expensive per kg than Ground 

Bottom line: using Mass as an OTA CER could easily lead one to 
make inappropriate programmatic decisions. 


General Conclusions 



Models are only as good as their data bases - we need more data. 

Larger OTAs cost more than Smaller, but Larger Diameter OTAs 
actually cost less per square meter of Collecting Aperture. 

Longer Wavelength OTAs cost less than Shorter. 

Cryogenic OTAs may cost less than Ambient. 

More study is required regarding cost reduction with year. 

If all parameters are held constant, adding mass reduces cost & 
reducing mass increases cost. 


